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1.  INTRODUCTION 


A.  Background 

High  speed  microprocessors  such  as 
the  Intel  3000  bit  slice  microprocessor 
(or  AMD  2901 ) offer  the  highest  speeds, 
the  most  flexibility,  and  the  greatest 
computing  power  available  (excluding 
perhaps  the  Motorola  10800  ECL 
microprocessor)  in  current  micropro- 
cessor technology.  The  high  speed 
microprocessors  are  directly  TTL 
compatible  and  as  such  can  interface 
to  TTL  LSI  parts.  The  processors  can 
achieve  from  6-10  million  operations 
per  second  and  are  certain  to  have  wide 
ranging  effects  on  military  hardware. 

Though  slower  speed  microproces- 
sors such  as  the  Intel  8080  and 
Motorola  6800  have  been  applied  in 
limited  ways  in  Army  seekers,  little 
has  been  done  to  exploit  the  capability 
of  high  speed  bipolar  microprocessors. 

This  report  details  an  application  of 
a high  speed  microprocessor  (Intel 
3000)  to  imaging  seekers.  The  work 
clearly  demonstrates  that  software  as 
opposed  to  hardware  can  be  used  as  the 
basis  for  a real  time  imaging  tracker. 
In  particular,  two  dimensional  corre- 
lation and  template  matching  nor- 
mally implemented  in  dedicated  hard- 
ware can  be  accomplished  in  real  time 
software.  The  bulk  of  this  report 
contains  a general  hardware  descrip- 
tion and  detailed  description  of  corr- 
elator software.  Software  for  an  optical 


contrast  tracker  appears  in  a separate 
report.  Both  trackers  operate  with  the 
same  hardware  and  the  only  difference 
between  the  two  trackers  is  software 
changes.  Thus,  the  software  approach 
yields  a tracker  that  is  capable  of 
radical  changes  in  tracking  mode.  The 
changes  can  be  effected  merely  by 
branching  to  different  software.  The 
implication  is  that  trackers  can  be 
built  that  modify  their  tracking  algor- 
ithms in  response  to  countermeasures 
or  battlefield  conditions.  Such  changes 
could  even  occur  after  missile  launch 
up  to  the  time  of  missile  and  target 
impact.  This  capability  has  the  effect 
of  increased  countermeasure  immun- 
ity. 

The  bit  slice,  microprogrammed 
architecture  of  the  Intel  3000  and  other 
similar  microprocessors  appears  to  be 
well  suited  to  many  military  applica- 
tions. This  follows  because  of  the 
following  reasons:  1)  Architecture  may 
be  tailored  to  fit  the  application.  2) 
Microword  structure  can  be  configured 
to  control  complex  hardware  in  parallel 
with  microprocessor  or  other  peripheral 
hardware  functions.  3)  The  device 
operates  at  very  high  speeds. 

In  light  of  this  report  the  develop- 
ment of  future  trackers  will  depend 
heavily  on  high  speed  software  and 
hardware  control.  This  follows  since 
high  speed  software  can  replace  much 
hardware.  Thus,  very  complex  tracking 
algorithms  not  practical  in  the  past 
because  of  size  and  complexity  are  now 
feasible. 


The  following  sections  detail  the 
design  of  a microprocessor  applied  to 
the  image  processing  problem.  The 
hardware  structure  and  software 
techniques  have  general  utility  and 
can  be  used  with  any  microprogram- 
med microprocessor.  The  tracking 
algorithms  developed  concentrate  on 
correlation  and  template  matching 
techniques,  but  the  hardware  with 
minimal  or  no  modification  can  be 
applied  to  other  tracking  algorithms. 
Though  the  tracking  algorithms  were 
developed  for  the  visible  spectrum, 
they  have  direct  application  to  other 
wavelengths. 

B.  Summary  of  Accomplishments 

Following  sections  detail  the  design 
and  construction  of  an  imaging  tracker 
built  inhouse.  The  program  was  very 
successful  and  nearly  all  of  the 
objectives  in  the  original  scope  of  work 
were  achieved.  The  program’s  major 
accomplishments  are  listed  as  follows: 
1)  Designed,  built,  and  tested  the  first 
Army  imaging  tracker  capable  of 
correlation  and  adaptive  gate  optical 
contrast  tracking.  2)  The  feasibility  of 
trackers  using  high  speed  micropro- 
cessors and  CCD  TV  technology  was 
demonstrated.  3)  Several  correlation 
and  template  matching  techniques 
were  studied  and  implemented  in  real 
time  microprocessor  software. 

The  work  documented  in  this  report 
is  by  no  means  complete  and  is 


expected  to  continue  into  FY78.  The 
emphasis,  however,  will  shift  to 
trackers  using  classical  pattern  recog- 
nition concepts  involving  feature 
extraction  and  classification. 

2.  HARDWARE 

DESCRIPTION  OF  THE 
COMPUTER  INTERFACE 
TO  THE  TRACKER 

A.  General 

This  section  is  designed  to  present  a 
general  description  of  hardware  used 
in  the  interface  of  the  tracker  computer 
to  an  existing  lab  minicomputer.  The 
level  of  detail  is  sufficient  for  a 
complete  understanding  of  the  soft- 
ware presented  in  later  sections.  A 
more  detailed  description  will  be  given 
in  a report  now  in  preparation. 

B.  Computer  Interface  Details 

In  order  to  develop  software  for  a 
microprocessor  a means  must  be 
generated  to  load  software  into  its 
memories.  By  far  the  most  convenient 
method  is  to  load  memory  from  cards 
or  disks  using  an  external  computer. 
The  hardware  in  this  system  was 
interfaced  to  an  existing  EAI 640  mini- 
computer. The  interface  is  an  import- 
ant part  of  the  system  since  it  allows 
tracker  software  development  to  occur 
with  minimum  turn  around.  Figure  1 
shows  a block  diagram  of  the  micro- 
processor memory  interface  to  the  EAI 
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Figure  1 
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640.  Memory  can  be  loaded  with  output 
from  cross  assemblers  resident  on  the 
EAI  640  or  directly  from  cards  or  disk 
files.  The  interface  is  bidirectional  so 
memory  can  be  written  into  or  dumped 
to  a line  printer.  The  play  card  shown 
is  a standard  EAI  parallel  interface 
containing  two  16  bit  output  latches 
(DF  and  DO)  and  one  16  bit  input  line 
(DI).  The  DF  latch  is  used  to  control  the 
mode  of  operation  and  address  mem- 
ory. Figure  2 gives  the  assignment  of 
function  to  bits  in  the  DF  latch.  The 
Decode  Logic  shown  in  Figure  1 is 
driven  by  the  5 most  significant  bits  of 
the  DF  latch.  The  output  from  the 
Decode  Logic  is  used  to:  put  multi- 
plexers in  their  proper  state,  select 
macro  or  micro  memory,  select  16  bit 
byte  of  memory,  select  read  or  write 
mode,  and  control  the  state  of  the 
transceivers.  As  shown  in  Figure  2 the 
least  significant  11  bits  of  the  DF  latch 
are  used  to  address  memory  when  DFO 
is  low.  An  extremely  important  feature 
of  the  system  diagrammed  in  Figure  1 
is  that  both  macro  and  micro  memories 
are  fabricated  with  random  access 
memories  (RAM).  This  makes  the 
system  developmental  in  nature  and 
all  software  can  be  easily  changed. 
After  development  most  of  the  RAM 
can  be  replaced  by  programmable  read 
only  memory  (PROM)  or  by  read  only 
memory  (ROM).  The  use  of  a ROM  in 
the  final  system  will  reduce  memory 
power  consumption  by  almost  a factor 
of  8 and  the  number  of  memory 
integrated  circuit  packages  from  96  to 
about  6 packages. 


3.  VIDEO  INTERFACE  TO 
MICROPROCESSOR 

A.  General  Description 

Figure  3 is  a reasonably  complete 
block  diagram  showing  the  interface 
of  a CCD  TV  camera  to  a micropro- 
cessor. The  heavy  lines  represent 
analog  signal  paths;  conversely, 
digital  signal  paths  are  represented  by 
lines  which  are  not  heavy.  The  dia- 
gram shows  that  camera  video  is 
digitized  by  a 4 bit  analog-to-digital 
converter  and  stored  in  an  image 
memory.  The  image  memory  can  be 
addressed  and  read  by  the  micro- 
processor which  is  used  to  generate 
tracking  algorithms. 

The  8 bit  latches  shown  at  the  top  of 
Figure  3 are  loaded  by  the  micro- 
processor and  are  used  to  control  the 
video  interface  hardware. 

B.  CCD  TV  Camera 

The  camera  used  in  the  tracker  hard- 
ware is  a Fairchild  201  CCD  TV 
camera  shown  in  Figure  4.  This 
particular  camera  was  selected  pri- 
marily because  of  its  availability 
within  the  lab.  Though  the  camera  has 
some  undesirable  properties,  it  proved 
adequate  to  demonstrate  tracking 
algorithms.  The  developed  algorithms 
are  independent  of  the  source  of  the 
image  data.  Therefore  tracking  algo- 
rithms developed  for  the  Fairchild  201 
CCD  TV  also  ha  x application  to 
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Figure  3.  Video  Interface  to  mlcropri 
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imaging  cameras  operating  in  the  3-5  CCD  201  solid  state  image  sensor  the 
micro  meter  and  8-14  micro  meter  photo  response  nonuniformity  is  on 
bands.  the  order  of  +15%  and  higher  gains 

were  not  indicated. 

The  Fairchild  camera  operates  in  the 

visible  spectrum  at  a frame  rate  of  123  The  BIAS  latch.  Figure  3,  is  used  to 
frames/sec  with  a resolution  100  x 100  drive  a digital  to  analog  converter 

elements.  The  camera  uses  2:1  interlace  (DAC).  In  this  case  the  DAC  output  is 

and  has  non-standard  composite  video  used  to  "buck  out  " DC  components 
output.  The  non-standard  video  re-  appearing  in  the  amplified  video, 
quired  a modified  TV  monitor  to  view 

the  TV  image,  and  made  recording  of  By  manipulating  the  GAIN  and 
the  video  difficult  with  standard  video  BIAS  latches  it  is  possible  to  optimize 
recorders.  Video  recordings  could  have  the  video  going  to  the  4 bit  analog  to 
been  made  with  specialized  recorders  digital  converter.  The  clipping  circuit 
but  the  high  cost  of  the  units  forced  the  shown  is  used  to  protect  the  A/D  from 
use  of  available  recorders.  Recordings  over  range  voltages, 
of  marginal  quality  have  been  made  of 

test  results  with  an  Ampex  recorder  by  The  MODE  latch,  Figure  3,  contains 

adjusting  the  recording  head  rate  5 bits  of  data  which  are  used  to  control: 
servo  for  a fairly  stable  lock  on  every  the  state  of  the  address  multiplexer 
4th  sync  pulse.  (MUX  shown  in  Figure  3),  the  gate 

color  (black  or  white),  the  gate  type 
Some  problems  were  also  experi-  (box  or  crosshairs),  enable  status,  and 
enced  from:  the  tendency  of  the  camera  frame  requests.  Figure  5 shows  the  bit 

to  bloom  on  bright  objects,  nonuni-  assignments  in  the  MODE  latch, 
formity  in  response  (pixel  to  pixel),  and  When  the  microprocessor  is  reading 

camera  produced  AGC.  data  from  the  image  memory,  the 

MUX  is  used  to  select  the  memory 
C.  Video  Interface  Control  Latches  address  register  of  the  microprocessor 

as  the  source  for  image  memory 
The  GAIN  latch,  Figure  3,  is  used  to  address.  When  status  is  enabled,  the 

control  a multiplying  digital  to  analog  conversion  control  logic  will  force  the 

converter  (MDAC).  The  MDAC  in  turn  sign  bit  of  the  I bus  high  after  a new 
controls  the  gain  of  the  video  ampli-  frame  has  been  stored  since  the  strobe 
fier.  The  gain  is  selectable  in  the  range  in  the  pipeline  register  is  enabled  in  the 

from  0.0  to  5.0.  Higher  gains  are  control  logic, 
possible  but  usable  gains  depend  on 

the  responsivity  variation  from  pixel  The  LEFT  COLUMN  latch,  Figure 
to  pixel  and  fixed  pattern  noise.  For  the  3,  defines  the  column  location  (1  to  100) 
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of  the  left  vertical  side  of  the  tracking 
gate. 

The  RIGHT  COLUMN  latch,  Figure 
3,  defines  the  column  location  ( 1 to  100) 
of  the  right  vertical  side  of  the  tracking 
gate. 

The  UPPER  ROW  latch,  in  Figure  3, 
defines  the  row  location  (1  to  100)  of  the 
upper,  horizontal  side  of  the  tracking 
gate. 

The  LOWER  ROW  latch,  Figure  3, 
defines  the  row  location  (1  to  100)  of  the 
lower,  horizontal  side  of  the  tracking 
gate. 

The  video  interface  control  latches 
can  be  loaded  by  addressing  the  latch 
by  the  MAR  register,  loading  the  AC 
register  with  data,  and  executing  a 
ROT  instruction  as  defined  in  Section 
7.A.  Addresses  for  the  various  latches 
are  given  in  Figure  3. 

D.  Row  and  Column  Count  Logic 

The  row  and  column  count  logic 
block  shown  in  Figure  3 is  driven  by 
the  same  clocks  that  are  used  to  scan 
the  CCD  image  array.  The  output  from 
the  row  and  column  count  logic  is  the 
true  row  and  column  location  of  the 
pixel  being  output  from  the  TV  camera. 
Since  the  camera  uses  2:1  interlace, 
logic  decoding  and  counters  are  neces- 
sary to  produce  the  true  row  and 


column  count.  The  row  count  ranges 
from  1 to  100  starting  in  the  uppermost 
row.  The  column  count  also  ranges 
from  1 to  100  but  starts  in  the  left  most 
column. 

E.  Tracking  Gate  Generation  Logic 

The  tracking  gate  generation  logic 
in  Figure  3 is  driven  by  the  true  row 
and  column  counts  and  the  mode  latch. 
The  left  column,  right  column,  upper 
row  and  lower  row  latches  define  the 
location  and  size  of  the  tracking  gate. 
The  mode  latch  determines  the  color 
(black  or  white)  and  type  of  gate 
(rectangle  or  crosshairs).  The  output 
from  the  tracking  gate  logic  drives  the 
video  amplifier  feeding  the  TV  monitor 
to  white  (black)  at  the  appropriate 
instants  to  generate  the  desired  track- 
ing gate. 

F.  Image  Memory  Address 
Generation 

The  image  memory  address  genera- 
tion logic  in  Figure  3 is  driven  by  the 
true  row  and  column  counts.  This 
circuit  contains  logic  to  store  data 
sequentially  into  image  memory  on  a 
line  basis  (2:1  interlace).  When  image 
data  is  stored  in  this  manner  address- 
ing of  image  data  by  the  microproces- 
sor becomes  an  easier  task  and  need 
not  take  into  account  the  effect  of  2:1 
interlace. 
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G.  Conversion  Control  Logic 


The  conversion  control  logic  in 
Figure  3 is  driven  by  the  same  clocks 
used  to  scan  the  CCD  array.  When  the 
frame  signal  is  high,  any  strobes 
generated  by  the  microprocessor  will 
result  in  a new  TV  frame  being  stored 
into  image  memory,  and  the  conversion 
control  logic  issues  convert  requests 
(REQ)  to  the  analog  to  digital  con- 
verter. The  converter  in  turn  issues  an 
end  of  conversion  signal  (EOC)  for 
each  request  (REQ).  When  data  has 
stabilized  and  an  EOC  has  been 
issued,  data  is  written  into  image 
memory  by  bringing  the  memory  write 
enable  low  (WE). 

Since  the  conversion  control  logic 
uses  the  clocks  which  are  also  used  to 
scan  the  CCD  array,  conversions  take 
place  as  pixel  data  is  shifted  from  the 
CCD  and  the  row  and  column  address 
of  each  new  pixel  is  known  for  each 
conversion  that  takes  place. 

H.  Image  Memory 

The  image  memory  can  store  10K  x 4 
bits  of  image  data  (all  100  x 100 
elements  of  the  array).  The  large 
memory  is  not  required  for  tracker 
operation  but  is  convenient  for  test 
purposes.  Most  correlation  trackers 
would  require  no  more  than  32  x 32  = 
1024  memory  locations.  The  output  of 
the  memory  is  placed  on  the  I bus  of  the 


microprocessor,  but  the  data  is  mean- 
ingful only  if  addresses  are  being 
supplied  from  the  microprocessor 
MAR  bus.  When  a frame  is  being 
stored  in  image  memory,  the  addresses 
are  generated  by  the  image  memory 
address  generation  logic. 

I.  TV  Monitor 

The  TV  monitor  shown  in  Figure  6 is 
used  to  monitor  video  and  also  the 
location  and  size  of  the  tracking  gate. 
In  normal  operation  video  is  supplied 
directly  to  the  monitor  summed  with 
the  tracking  gate  signal.  However,  the 
monitor  can  also  be  used  to  display  the 
stored  image  in  image  memory.  When 
data  is  not  being  written  into  image 
memory,  image  data  is  available  on 
the  output  of  image  memory.  The 
output  is  used  to  drive  a digital  to 
analog  converter  (DAC).  The  output 
from  the  DAC  is  summed  with  TV  sync 
and  the  tracking  gate  signal 
generating  a composite  video  signal 
for  the  monitor.  The  image  memory, 
address  generation  logic  supplies 
addresses  to  image  memory  in 
synchronization  with  the  clocks  used 
scan  to  the  CCD  image  array.  The 
propagation  delay  form  clocks  to  DAC 
output  causes  the  video  to  be  shifted 
relative  to  real  time  video,  but  still 
produces  a very  useful  display.  For 
example,  the  display  can  be  used  to 
determine  the  effects  of  preprocessing 
(gain  and  bias  latches)  on  the  video 
from  the  camera. 


4.  MICROPROCESSOR  AND 
TRACKER  HARDWARE 

A.  Physical  Description 

Figure  6 is  a photograph  of  the  com- 
pleted tracker  and  Figure  7 is  a close  up 
of  the  operator’s  panel.  The  thumb 
wheel  switches  shown  in  the  figure 
drive  address  halt  hardware.  An 
address  halt  can  be  executed  at  any 
macroinstruction  at  any  point  within 
its  microcode  by  setting  addresses  into 
the  thumb  wheel  switches. 

The  selector  switch  shown  at  the  left 
side  of  the  panel  drives  multiplexer 
hardware  which  can  display  virtually 
any  bus  within  the  system.  The 
column  of  switches  to  the  right  of  the 
panel  are  software  sense  switches  used 
for  force  branches  in  software. 

The  white  switches  to  the  lower  right 
are  the  run  (start  the  clock)  and  single 
switches  (one  clock  pulse  per  depres- 
sion). Since  all  memory  can  be  read, 
modified  and  written  into  from  the 
minicomputer  there  is  no  need  to 
provide  for  these  functions  through 
front  panel  switches.  The  toggle 
switch  located  at  the  center,  bottom 
portion  of  the  panel  selects  one  of  two 
possible  sources  of  video  for  the  TV 
monitor.  Video  can  be  displayed 
directly  from  the  camera  or  video 
generated  from  stored  image  data  can 
be  displayed.  The  toggle  switch  to  the 
far  right,  bottom  of  the  panel  is  used  to 
take  control  of  the  data  bus  from  the 


minicomputer.  Finally,  the  small 
momentary  push  button  switch  locat- 
ed to  the  left  of  the  run  and  single 
switches  is  used  to  reset  hardware. 
Figures  8 and  9 show  all  of  the  circuit 
boards  used  in  the  tracker.  Multiplexer 
boards  are  not  shown.  Some  of  the 
components  on  the  memory  boards  are 
taken  up  by  minicomputer  interface 
circuit  components.  It  should  be  noted 
that  no  attempt  was  made  to  minimize 
package  size.  Many  improvements 
could  be  made  along  these  lines.  As  an 
example  the  2K  x 48  bit  RAM  micro 
memory  could  be  implemented  with 
1024  x 8 PROMs  reducing  the  package 
count  from  96  to  6 and  the  power 
requirements  by  a factor  of  8. 

B.  Microprocessor  and  Tracker 
Architecture 

The  microprocessor  shown  in  Figure 
3 is  shown  in  more  detail  in  Figure  10. 
The  microprocessor  is  the  Intel  3000 
used  in  a standard  pipelined  configu- 
ration. The  loop  counters  shown  are 
used  extensively  in  image  processing. 
The  counters  can  be  addressed  and 
loaded,  or  addressed  and  incremented 
and  tested  on  a single  microcycle.  The 
counters  are  used  primarily  to  keep 
track  of  loop  counts  in  the  nested  loop 
computations  that  occur  in  image 
processing  (e.g.  convolution  and  corre- 
lation computations). 

Since  counting,  loading  or  testing 
can  occur  in  parallel  with  micro- 
processor functions  the  overhead 
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Figure  8.  Macro  and  Micro  memory  boards 
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Figure  9.  Microprocessor,  image  memory,  and  video  front  end  boards. 


diagram  of  microprocessor  and  tracker  architecture. 
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associated  with  loop  counting  is 
reduced  to  zero.  If  no  more  than  four 
loop  counters  are  needed  simultane- 
ously, then  no  registers  internal  to  the 
microprocessor  need  be  wasted  on  loop 
counting. 

The  function  generation  hardware 
also  shown  in  Figure  10  can  be 
programmed  to  generate  several  oper- 
ations which  occur  frequently  in 
template  matching  or  correlation 
computations  by  table  look  up.  The 
hardware  accepts  two  4 bit  operands  A 
and  B,  and  will  output  a single  8 bit 
result  C on  command.  Typical  func- 
tions which  can  be  generated  include: 
l.C  = A",B,2. C=|  A — B|, and  3.C=(A- 
B)2.  With  the  arrangement  shown 
operand  A is  supplied  directly  from  the 
least  significant  4 bits  of  memory  and 
operand  B is  placed  on  the  least 
significant  4 bits  of  the  AC  bus.  This 
circuit  was  specifically  designed  to 
minimize  the  number  of  microcycles  in 
correlation  and  template  matching 
processing. 

The  bit  slice  architecture  of  the  Intel 
3000  allows  a maximum  of  flexibility 
in  designing  a system  for  optimum 
performance.  The  word  lengths  of 
macromemory  and  micromemory  can 
be  tailored  to  suit  the  application.  In 
this  case  the  tracker  was  built  with  a 20 
bit  macromemory  and  a 48  bit  micro- 
memory. The  20  bit  word  is  overkill  for 
the  tracker  and  could  be  reduced  to  16 
(possibly  12  bits)  with  relatively  minor 
modifications  to  the  hardware.  On  the 


other  hand  micromemory  could  be 
expanded  to  64  bits  if  more  hardware 
control  is  required.  More  hardware 
control  could  be  required  if  hardware 
external  to  the  microprocessor  is 
needed  for  tracker  development. 

C.  Microinstruction  Format 

Figure  11  shows  the  microinstruc- 
tion word  used  in  the  tracker.  The 
microinstruction  detailed  in  the  figure 
contains  a great  deal  of  information 
concerning  the  hardware.  This  is  not 
surprising  since  the  microinstruction 
controls  all  elements  of  the  micro- 
processor hardware.  Fields  1,  2,  and  3 
are  standard  Intel  fields.  Notation 
where  possible  follows  notation  used 
by  Intel.  Field  4 is  the  K bus  control 
field  which  drive  the  decode  logic 
shown  in  Figure  10.  The  decode  logic 
generates  the  required  20  bit  wide  word 
for  the  K bus  input  on  the  3002  CPU. 
Field  8 is  the  logic  strobe  bit  which  can 
be  used  for  a data  strobe.  The  strobe  is 
used  to  request  a new  video  frame  in 
the  conversion  control  logic  shown  in 
Figure  3.  Field  5 is  used  to  page  micro- 
memory. The  Intel  3001  microse- 
quencer is  capable  of  addressing  up  to 
512  memory  locations  with  9 address 
lines.  Thus  in  order  to  address  2K  of 
memory  two  additional  address  lines 
are  required  and  are  supplied  by  the 
pipeline  register.  Field  6 is  used  to 
control  the  data  buses  and  clocks. 
Details  are  given  in  Section  4.C.  Field  7 
is  the  pause  field.  The  pause  field  can 
be  used  to  halt  the  microprocessor  by 
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Figure  11.  Microinstruction  format  (48  bits). 


stopping  the  dock.  The  feature  is 
useful  in  debugging  operations.  Field  9 
is  used  to  select  a loop  counted  to  be 
loaded,  incremented,  or  tested.  Field  10 
is  used  to  load  input  on  all  loop 
counters.  Field  1 1 is  the  last  field  and  is 
used  to  control  the  multiplier  hard- 
ware. 

D.  Bus  Control  Logic 

The  bus  control  logic  block  shown  in 
Figure  10  is  driven  by  a 3 bit  field  in  the 
pipeline  register.  The  mnemonics, 
codes  and  functions  associated  with 
the  bus  control  field  are  given  in  Figure 
12.  Figure  13  is  a simplified  diagram  of 
the  bus  control  logic.  The  circuit 
generates  the  following  signals: 
macromemory  chip  select  (CS),  macro- 
memory write  enable  (WE),  memory 

address  enable  (MEMAE),  and  the 
memory  data  enable  (MEMDE).  The 
circuit  contains  the  necessary  logic  to 
generate  all  clocking  signals,  and 
produces  stretched  microcycles  for 
memory  reads  and  writes  as  shown  in 


the  timing  diagram  of  Figure  14.  The 
circuit  shown  is  a modification  of  the 
one  given  in  Intel  literature  [1]. 

E.  Function  Generation  Circuit 
Details 

Figure  10  shows  the  function  genera- 
tion circuit  used  in  correlation  compu- 
tations. A single  bit  from  micro- 
memory is  used  to  enable  the  circuit 
(MULT)  and  disable  normal  video 
memory  outputs  that  are  routed  to  the  I 
bus  input  (3002).  The  circuit  as  shown 
allows  data  in  the  AC  register  and 
memory  to  be  simultaneously  operated 
on  by  the  table  look  up  hardware.  The 
memory  address  is  supplied  by  the 
MAR  register,  and  the  output  from  the 
circuit  is  routed  to  the  I bus  input  of  the 
CPU  (3002).  The  heart  of  the  circuit  is 
the  512  x 8 programmable  read  only 
memory  (PROM)  which  can  be 
programmed  to  produce  any  of  two 
(switch  selectable)  8 bit  results  from  4 
bit  inputs.  A typical  sequence  of 
microinstructions  for  function 
generation  is  given  below. 
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Hardware  timing  is  shown  in  Figure 
15  and  relates  directly  to  the  example 
given  above.  The  logic  signal  MEMAE 
is  the  macromemory  address  enable 
generated  by  the  bus  control  logic,  and 
the  logic  signal  MULT  is  asserted 
(active  low)  by  a bit  in  the  micro- 
instruction word  (MULT).  The 
stretched  cycles  for  slow  memory  are 
evident  in  the  diagram. 

F.  Loop  Counting  Circuit  Details 

Figure  16  shows  the  details  of  loop 
counting  hardware.  There  are  four 
counters  shown,  thus,  loop  counts  for 
four  computation  loops  may  be  main- 
tained simultaneously.  The  counters 
have  general  utility  and  are  especially 
useful  when  dealing  with  nested  loops 
appearing  in  image  processing.  The 
counters  may  be  loaded  (or 
incremented  and  tested)  simultaneous- 
ly with  CPU  operations  of  the  Intel 


3002.  The  field  mnemonics  and 
associated  hardware  control  word  are 
shown  in  Figure  16.  In  practice  a loop 
counter  is  initialized  by  loading  a 
selected  counter  with  the  ones 
complemented  of  the  desired  loop 
count.  The  counter  can  be  incremented 
and  tested  as  required  by  testing  for  a 
carry  from  the  counter.  When  counters 
are  not  being  tested  or  loaded,  the 
source  of  the  Intel  3001  FI  input  is  the 
carry  out  (CO)  from  the  Intel  3002. 

An  example  segment  of  code  is  given 
below  showing  how  a counter  is  loaded 
and  then  tested  by  the  JFL  instruction 
of  the  Intel  3001. 

The  clock  signals  shown  in  Figure  16 
are  delayed  Vi  of  a microcycle  from  the 
MCU  clock  so  that  loading  (or 
incrementation  and  testing)  can  be 
accomplished  in  a single  microcycle. 
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G.  K But  Encode  Logic 

Figure  10  shows  a K bus  encode  logic 
block.  This  important  circuit  is  used  to 
generate  constants  and  masks  in 
microcode.  The  circuit  accepts  8 bits  as 
an  input  and  produces  20  bits  as  an 
output.  Figure  17  shows  the  10  Intel 
3001  slices  used  to  make  a 20  bit 
processor  and  the  K bus  wiring.  The 
signals  K0  through  K7  are  generated 
as  a field  in  micromemory  shown  in 
Figure  11.  With  the  proper  selection  of 
bit  pattens  the  constants  and  masks 
shown  in  Figure  18  can  be  generated. 

5.  UTILITY  SOFTWARE 

A.  General  Description 

Utility  software  will  be  described  in 
detail  in  the  hardware  report  now 
being  prepared.  This  section  contains 
only  a general  description  of  the 
software. 

B.  Memory  Test  Software 

Section  2.B  contains  a description  of 
the  minicomputer  interface  to  memory 
hardware.  Since  the  minicomputer  can 
load  and  dump  the  contents  of  both 
memories  (macro  and  micro),  software 
has  been  written  to  test  memories  by 
loading  test  bit  patterns.  The  memories 
are  then  read  to  check  for  the  expected 
patterns.  Failures  are  printed  to  isolate 
the  source  of  the  problem. 


C.  Microcode  Loading  Procedure 

The  microcode  to  be  tested  is  first 
punched  into  cards.  The  cards  form  the 
source  deck  for  a cross  micro  assembler 
CROMIS  [2].  The  cross  assembler 
operates  on  the  CDC  6600  digital 
computer  and  produces  punch  card 
output  (machine  code)  along  with  a 
listing  of  the  assembly.  The  card 
output  is  then  loaded  on  to  the  E AI 640 
disk  (Figure  1)  under  a file  name.  The 
file  can  be  loaded  into  micromemory  as 
required  by  calling  the  file  from  the 
disk. 

D.  Macrocode  Loading  Procedure 

Macrocode  is  assembled  and  loaded 
directly  by  an  EAI 640  cross  assembler 
and  loader.  The  assembler  is  a two 
pass  assembler  which  uses  mnemonics 
similar  to  the  EAI  640  instruction  set. 
Some  special  instructions  have  been 
added  that  relate  to  special  tracker 
microcode.  The  complete  set  of  mne- 
monics used  in  the  tracker  is  given  in 
Section  7. 


6.  CORRELATION  AND 
TEMPLATE  MATCHING 
TRACKER 

A.  General  Description 

The  remainder  of  this  report  is 
devoted  to  a description  of  the  corr- 
elation tracker  developed  for  the 
hardware  described  in  Sections  2,  3, 
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Figure  18.  Bits  patterns  required  for  K bus  constants  and  masks  generation. 
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and  4.  The  tracker  is  unique  in  that  it 
operates  in  real  time  and  uses  almost 
100%  software  to  execute  algorithms. 

Appendix  A contains  a listing  of  the 
tracker  macrocode.  The  macrocode 
contains  EAI  640  instructions  (emu- 
lation) along  with  some  special  instruc- 
tions associated  with  the  tracker.  The 
EAI  640  instructions  are  given  in 
Section  6.B.  The  special  instructions, 
described  in  detail  in  Section  7, 
represent  the  bulk  of  the  tracker 
software.  The  software  described  in 
these  sections  is  written  on  the  micro- 
code level  to  achieve  maximum  effi- 
ciency. A complete  listing  can  be  found 
in  Appendix  B. 

B.  Correlation  and  Template 
Matching  Algorithm* 


video  memory  123  times  a second 
during  the  vertical  blanking  interval. 
The  reference  array  is  obtained  from 
the  image  array  and  stored  separately 
when  tracking  is  initiated.  The  refer- 
ence array  contains  the  "signature"  of 
the  target  and  is  not  changed  or 
updated  until  correlation  quality 
degrades.  Correlation  quality  degrades 
typically  due  to  range  closure  or  target 
aspect  changes.  The  correlation  or 
template  matching  algorithm  is  used 
to  locate  the  point  of  best  match  of  the 
reference  array  and  a 9 * 9 subarray  of 
the  image  array.  The  point  of  best 
match  is  determined  from  the  maxi- 
mum or  minimum  of  a function  which 
in  some  way  measures  the  quality  of 
the  match.  Equations  6.1  through  6.3 
define  all  the  correlation  algorithms  or 
normalized  correlation  algorithms 


The  complete  tracker  will  be  de- 
scribed in  Section  6.C.  This  section 
identifies  several  correlation  and 
template  matching  algorithms  selected 
for  study.  Though  several  algorithms 
were  tested,  all  operate  on  two  image 
subarrays  as  defined  in  Figure  19.  The 
17  x 17  image  array  1(1,  J)  is  part  of  the 
100  x 100  image  produced  by  the 
camera.  The  smaller  9*9  reference 
array  R(I,J),  bounded  by  the  tracking 
gate,  contains  a high  percentage  of 
target  pixels  relative  to  background 
pixels. 


|C(M,N)}=  Z Z I(K,L)  * R(I,J) 

i-1  j-1 

6.2 

9 9 

E L I(K,L)*R(I,J) 

^~2 

Z Z I (K,L)  z z IT(I,J) 

1*1  J-1  I-1J=1 


6.3 

9 9 

{ C(M,N)|-  Z Z (I(K,L)-I)*(R(I,J)-R) 
1-1 J-1 


9 9 

jE(M,N)f-  Z Z | I(K,L)-R(I,J) | 
I-1J-1 


The  image  array  is  always  centered 
at  the  current  track  point  (NX,  NY). 
The  image  array  is  read  from  the  10K 
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Figure  19.  Definition  of  image  and  reference  arrays. 
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6.5 


99  2 

/e(M,N)1  - L Z (I(K,L)-R(I,J)) 

* ' 1=1  J=1 

where  K=I+M-1 , L=J+N-1,  l£M<_9, 

1 < N < 9 and  where 


9 9 

R = 1 Z Z R(I,J) 
81  1=1  J=1 


9 9 

I = 1 Z Z 1(1, J) 

81  1=1  J=1 

tested  from  imagery  from  the  Fairchild 
201  CCD  TV.  As  a preliminary  test,  a 
35MM  slide  representative  of  the  IR 
signature  of  a target  was  projected  on  a 
screen.  The  image  data  obtained  in 
this  manner  is  approximately  repre- 
sentative of  the  image  data  from  a 
camera  operating  in  the  IR  spectrum. 

Figure  20  is  a photograph  of  the  TV 
monitor  showing  the  projected  image 
of  such  a slide.  The  bright  areas 
correspond  to  the  hottest  areas  in 
target,  which  in  this  case,  are  the 
tracks  and  boggey  wheels. 

The  image  and  reference  arrays 
shown  in  Figure  21  were  obtained  from 
the  Fairchild  201  CCD  TV  and  micro- 
processor hardware.  The  reference 
array  is  the  center  9 * 9 of  the  17  * 17 


image  array.  The  arrays  were  used  to 
test  the  candidate  tracking  algorithms 
listed  in  Equations  6.1  through  6.5. 
Each  algorithms  results  in  a 9 * 9 array 
C (M.N)  or  E(M,N). 

The  correlation  value  and  the  side 
lobes  of  the  match  point  give  an 
indication  of  the  robustness  of  the 
algorithm.  Results  from  Equations  6.1 
thro  ugh  6.5  are  presented  in  Figures  22 
through  26  respectively.  It  is  clear  from 
the  testing  that  scene  brightness 
variation  causes  false  peaks  in  the 
unnormalized  correlation  result  The 
results  were  surprising  in  view  of  the 
fact  the  shifting  distance  is  so  small. 
This  test  is  representative  of  other 
results  which  also  indicate  the  un- 
normalized  correlation  is  not  adequate 
as  a tracking  algorithm.  Two  normal- 
ization schemes  were  tried  on  the  same 
data  with  improved  results.  In  the  case 
of  normalization  by  norms  the  Cauchy 
Schwarz  inequality  guarantees  a 
result  less  than  one  and  less  sensitivity 
to  scene  brightness  variation.  The 
result  is  given  in  Figure  23.  Normal- 
ization by  means  as  in  Equation  6.3 
gives  similar  results  as  shown  in 
Figure  24.  From  an  implementation 
point  of  view  normalization  by  means 
is  more  difficult  As  shown  in  Equation 
6.3  the  mean  of  the  image  9 * 9 
subarray  and  reference  arrays  must  be 
known  before  the  computation  takes 
place.  On  the  other  hand,  though  a 
division  is  required,  the  normalization 
by  norms  for  each  correlation  result 
can  take  place  after  the  standard 
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Figure  20.  Video  IR  image  of  the  side  view  of  an  M48  tank. 
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correlation.  The  norm  of  the  image 
array  may  be  conveniently  computed 
at  the  same  time  as  the  correlation 
result.  Two  template  matching  algor- 
ithms [3]  shown  in  Equation  6.4  and 
6.5  were  also  tested  with  good  results. 
Template  algorithms  may  be  rigor- 
ously defined  in  terms  of  a distance 
metric  [4].  The  result  from  testing  is 
given  in  Figure  25  and  Figure  26 
respectively.  It  should  be  noted  that 
Equation  6.5  contains  a correlation 
computation  which  is  evident  when 
the  squared  term  is  multiplied  out.  The 
algorithms  in  Equations  6.1,  6.4,  and 
6.5  have  been  implemented  in  real 
time.  This  report,  however,  contains 
only  the  software  for  the  algorithms  in 
Equations  6.4  and  6.5.  The  execution 
times  for  these  algorithms  as  defined 
in  the  equations  is  on  the  order  of  6.46 
ms  with  a 160  nsec  cycle  time  and  a320 
nsec  memory  read  cycle. 

C.  Tracker  Description 

This  section  describes  the  operation 
of  the  tracker  macrosoftware  given  in 
Appendix  A.  An  examination  of  the 
software  mnemonics  show  that  the 
code  is  basically  typical  minicomputer 
code  as  defined  in  Section  7.A.  The 
exceptions  are:  WIN,  COR,  STD, 
CROSS,  FRM,  WAT,  IMG,  REF,  MNV, 
and  LAIBUS. 

These  instructions  are  covered  here 
briefly  and  in  more  detail  in  Section 
7.C.  The  variables  and  constants  in 
cells  208  through  418  can  be  easily 
accessed  in  microcode  by  constants 
generated  in  the  K bus  logic.  A 


complete  list  of  variable  names  and 
definitions  are  given  in  Figure  27. 

The  tracker  code  given  in  Appendix 
A contains  both  adaptive  gate  centroid 
code  and  template  matching  code.  The 
following  sections  contain  only  a 
description  of  the  template  matching 
code  which  starts  at  label  START  2. 
The  adaptive  gate  tracker  code  is 
documented  in  a separate  report  [5]. 

Tracker  operation  can  be  broken  into 
two  major  computation  loops,  the  scan 
loop  and  the  track  loop.  These  compu- 
tation loops  are  flow  charted  in 
Figures  28  and  29  respectively.  The 
hardware  reset  shown  at  the  top  of 
Figure  28  initializes  the  tracker  hard- 
ware and  software.  When  initialization 
is  complete,  a crosshair  is  displayed  as 
an  overlay  on  the  TV  monitor,  centered 
at  column  50,  row  50  (NX  = NY  = 50)  as 
shown  in  Figure  20.  The  crosshair  is 
produced  by  routine  CROSS.  The 
operator  then  aims  the  camera  at  the 
target  to  be  tracked.  In  roughly  .5 
seconds  the  image  data  is  scanned  and 
the  GAIN  and  BIAS  latches  are  set  to 
optimum  values.  The  iterative  process 
of  setting  the  GAIN  and  BIAS  latches 
continues  until  the  track  switch  is 
turned  on.  At  this  point  the  track  loop 
is  entered  as  shown  in  Figure  29.  The 
AGC  conditions  existing  at  the  time  of 
track  initiation  are  stored.  Then 
continuing  AGC  action  maintains  the 
quality  of  the  reference  in  spite  of 
changes  in  scene  brightness  and  local 
area  responsivity  in  the  CCD  TV 
camera.  The  reference  array  is  stored 
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VARIABLE 

NAME 

DEFINITION 

SSW7 

CONSTANT,  USED  TO  SELECT  SSW7 

ONEMC1 

CONSTANT,  USED  IN  FILTER  EQUATION 

FRMRQ 

CONSTANT 

ONE 

CONSTANT 

IP 

CONSTANT,  IMAGE  POINTER 

RP 

CONSTANT,  REFERENCE  POINTER 

CP 

CONSTANT,  CORRELATION  POINTER 

IP2 

(NOT  USED) 

MEAN 

VARIABLE,  (MEAN  VALUE)*81 

STD 

VARIABLE,  (MEAN  DEVIATION)*81 

MAXI 

VARIABLE,  MAXIMUM  OF  CORRELATION  ARRAY 

MINI 

VARIABLE,  MINIMUM  OF  CORRELATION  ARRAY 

NX 

VARIABLE,  CURRENT  COLUMN  TRACK  POINT 

NY 

VARIABLE,  CURRENT  ROW  TRACK  POINT 

DELXX 

VARIABLE,  DELTA  ROW  TRACK  CORRECTION 

DELYY 

VARIABLE,  DELTA  COLUMN  TRACK  CORRECTION 

MODE 

VARIABLE,  CURRENT  MODE  LATCH 

BWC 

VARIABLE,  CURRENT  BLACK/WHITE  CONTROL  WORD 

GAIN 

VARIABLE,  CURRENT  GAIN  LATCH  VALUE 

BIAS 

VARIABLE,  CURRENT  BIAS  LATCH  VALUE 

TP5 

CONSTANT,  (DEC  .5) 

TIP5 

CONSTANT,  (DEC  1.5) 

N10 

CONSTANT,  LIMIT  FOR  TRACKING  AREA 

N90 

CONSTANT,  LIMIT  FOR  TRACKING  AREA 

TP5D 

CONSTANT,  (DEC  .5) 

TIP5D 

CONSTANT.  (DEC  1.5) 

T7PO 

CONSTANT,  (DEC  7.0) 

T8PO 

CONSTANT,  (DEC  8.0) 

T14P5 

CONSTANT,  (DEC  14.5) 

T13P5 

CONSTANT,  (DEC  13.5) 

T31 

CONSTANT.  INITIAL  VALUE  FOR  GAIN  LATCH 

DCBLK 

CONSTANT,  INITIAL  VALUE  FOR  BIAS  LATCH 

T81 

CONSTANT,  (DEC  81) 

T81PRM 

CONSTANT,  (DEC  81) 

ONEONE 

CONSTANT,  BIAS  ADJUSTMENT  CONSTANT 

ONEMC2 

CONSTANT,  FILTER  EQUATION 

C2 

CONSTANT,  FILTER  EQUATION 

GP933 

CONSTANT,  GAIN  ADJUSTMENT  FACTOR 

FIFTY 

CONSTANT,  (DEC  50) 

FULLG 

CONSTANT,  MAXIMUM  GAIN  LIMIT 

FULLB 

CONSTANT,  MINIMUM  BIAS  LIMIT 

ZERO 

CONSTANT 

MNSBPK 

VARIABLE,  BIAS  ADJUSTMENT  PARAMETER 

SDSBPK 

VARIABLE,  AGC  ADJUSTMENT  PARAMETER 

MNPK 

VARIABLE.  BIAS  ADJUSTMENT  PARAMETER 

MNSPK 

(NOT  USED) 

SDPK 

VARIABLE,  AGC  ADJUSTMENT  PARAMETER 

TEMP 

VARIABLE,  WORKING 

MEANO 

VARIABLE,  OLD  VALUE  OF  MEAN 

ST  DO 

VARIABLE,  OLD  VALUE  OF  MEAN  DEVIATION 

Cl 

CONSTANT,  FILTER  EQUATION 

Figure  27.  List  of  variable  names  and  definitions. 


Figure  28.  Flow  chart  of  scan  loop. 
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and  a new  image  array  is  read  in  while 
computation  continues  (in  parallel).  At 
this  point  the  template  matching 
algorithm  finds  the  point  of  best  match 
and  the  tracking  gate  positions  are 
updated.  New  mean  and  mean  de- 
viation values  are  computed  for  the  9 * 
9 subarray  centered  at  the  track  point. 
The  mean  and  mean  deviation  are 
then  filtered  and  subsequently  used  by 
the  iterative  gain  and  bias  adjustment 
software.  The  reference  array  is 
updated  if  the  quality  of  match  is 
degraded.  This  closes  the  track  loop 
which  starts  by  reading  in  a new 
image  array.  The  iterative  gain  and 
bias  computations  appear  in  both  the 
scan  and  track  loops.  The  details  of  the 
computation  are  given  in  Figure  30. 
The  computation  starts  after  the  fil- 
tered mean  and  mean  deviation  have 
been  computed.  The  mean  is  computed 
by  the  equation. 


9 9 

M = l Z Z I’(I,J) 

81  1=1  J=1 

where  I'  (I,J)  is  the  9*9  subarray 
centered  at  the  current  track  point. 
Similarly  the  mean  deviation  is  com- 
puted by 


9 9 

MD  = Z Z 1 1 ’ ( I , J > -M  | 

81  1=1  J=1 


The  filter  equations  are  given  in  Figure 
28.  It  should  be  noted  that  in  the  scan 


loop  the  following  constants  are  held 
to  fixed  values  indicated  below. 

MNPK  = 8 
MNSBPK  = 7 
SDPK  = 14.5 
SDSBPK  = 13.5 


This  choice  of  the  constants  has  the 
effect  of  optimizing  the  gain  and  bias 
settings  so  that  the  full  range  of  the 
analog-to-digital  converter  is  utilized 
(0  to  15  counts).  The  effect  of  successive 
iterations  is  that  the  9*9  subarray  has 
a mean  value  of  7.5  counts  and  a 
dispersion  (4a  (K+l))  of  14  counts. 
Since  gain  is  limited  to  5,  the  dispersion 
may  not  reach  14  counts  for  very  low 
contrast  targets,  but  the  mean  will 
always  reach  7.5  (filtered  value).  This 
technique  can  cause  extremely  bright 
or  dark  objects  to  be  clipped  to  15  or  0 
counts  respectively,  but  the  overall 
effect  is  to  enhance  the  available 
contrast  in  the  target.  The  software 
AGC  performed  quite  well,  and  enabled 
the  tracker  to  track  the  detail  that 
exists  in  a piece  of  plain  white  bond 
typing  paper  in  preliminary  lab  tests 
as  shown  in  Figure  31 . Figure  32  shows 
the  enhancement  of  a very  low  contrast 
target  which  is  barely  visible  on  the 
monitor.  Figure  33  shows  results  of  a 
real  time  scan  and  track  loop  tests  on  a 
simulated  M48  tank  target. 
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MD<SDSBPK 


Y 


GO  = GAIN 
GAIN  = GAIN/933 


r^AiM  = n it  i n 

GAIN  = GAIN  * .933  Y ^ 

'md>sdpk 

<GAIN>FULL  G 

Q = GO/FULL  G 

BIAS  = BIAS  * .933 

BIAS  = BIAS  ' Q 

BIAS  = BIAS/ .933 


BIAS>FULL  B BIAS  = FULL  BL 


M<MNSBPK  BIAS  = BIAS +1 


[BIAS  = FULL  B HC  bias>full  b 


BIAS<0 


BIAS  = BIAS  - 1 


BIAS  = 0 


M>MNPK 


RETURN 


Figure  30.  Iterative  GAIN  and  BIAS  flow  chart. 
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The  reference  update  software  is  not 
given  in  this  report  though  several 
methods  for  measuring  the  quality  of 
the  template  match  have  been  at- 
tempted. The  methods  generally  in- 
volve the  examination  of  the  side  lobes 
of  the  E(M,  N)  array  about  the  point  of 
match.  No  suitable  wide  range  zoom 
lens  was  available  to  make  the  neces- 
sary tests  for  developing  the  algor- 
ithms. It  is  hoped  that  a wide  range 
zoom  will  be  available  in  FY78  so  that 
the  algorithms  can  be  developed.  One 
approach  for  checking  quality  is  to 
compute 

Q ■ (E(M'N,|  Lx  - !E(M'W|  Lin 

and  to  examine  the  side  lobes  about 
{m,nj  « {(m,n) | E(m,n)  minimum} 

Define  the  set 

{ D } = {E(m,n)-E(k,je)|  jm-k|=l, 

Then  if  Q<T<,  and  D|  min  <T,  (T,  and  T, 
are  thresholds)  the  reference  array  is 
updated.  A change  in  the  color  in  the 
tracking  gate  has  been  used  as  a que  to 
the  operator  that  a reference  update 
has  taken  place. 


7.  DETAILED  SOFTWARE 
DESCRIPTION 

A.  EAI  640  Emulation  Code 

A subset  of  the  EAI  640 
minicomputer  instruction  set  has  been 
emulated  on  the  Intel  3000 
microprocessor.  A listing  of  the  code  is 
given  in  Appendix  C.  The  code 
operates  roughly  4 times  faster,  than 
the  EAI  640  and  about  2 times  faster 
than  the  Pacer  100,  a newer  model  EAI 
digital  computer. 

The  basic  set  of  macroinstructions 
shown  in  Figures  34  through  37  is  a 
modified  EAI  640  instruction  set.  The 
symbols  A,X,  P,  S,  and  W in  the 
"operation  performed"  column  refer  to 
the  microprogrammed  machine's  re- 
gisters: accumulator,  index  register, 
program  counter,  stack  pointer  and 
status  register  respectively.  The 
macroinstructions  are  all  20  bits  wide 
and  have  two  possible  formats  shown 
below. 

Memory  reference 


|A  B 6 bit  OP  Code 

12  bit  Displacement 

2 bit  address  option 

Other 

8 bit  OP  Code 

12  bit  Displacement 
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CODE 

BINARY 

OCT 

LA 

ABOO  0000 

000 

C(E)  — A 

STA 

A BOO  0001 

001 

A — C(E) 

LX 

ABOO  0010 

002 

C(E)  •—  X 

STX 

ABOO  0011 

003 

X — C(E) 

A 

AB01  0100 

004 

A+C(E)  — •»  A 

S 

ABOO  0101 

005 

A-C(E)  A 

M 

ABOO  0110 

006 

A*C(E)  — ► A 

D 

ABOO  0111 

007 

A/C(E)  — ► A 

AOM 

ABOO  1000 

010 

A-M  — ► A 

OR 

ABOO  1001 

Oil 

AVC(E)  — ► A 

XOR 

ABOO  1010 

012 

A+C(E)  — ► A 

AND 

ABOO  1011 

013 

A C(E)  — ► A 

C 

ABOO  1100 

014 

SET  FLAG  FOR  SKIP  INSTRUCTIONS 

NOT  USED 

ABOO  1101 

015 

NOT  USED 

ABOO  1110 

016 

NOT  USED 

ABOO  1111 

017 

J 

AB01  0000 

020 

D — ► P (OR  C(E)  — ► P) 

L 

AB10  0000 

040 

P-^  S,  S+1  -►  S,  D -►  P (OR  C(E)-^P) 

i 


ADDRESS 

OP 

DISPLACE- 

AB 

ADDRESS  OPTION 

OPTION 

CODE 

MENT 

00 

— 

Direct 

MEMORY  REFERENCE  CODE  Z 

OP 

D 

01 

Indirect 

2 bits 

6 bits 

12  bits 

10 

Indexed 

11 

Indirect,  Indexed 

I 


Figure  34.  Memory  reference  instruction*. 
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CODE 

BINARY 

CLR 

0011  0000 

AOA 

0011  0001 

CAO 

0011  0010 

TCA 

0011  0011 

ARS 

0011  0100 

ALS 

0011  0101 

LRS 

0011  0110 

SSP 

0011  0111 

SSN 

0011  1000 

EX 

0011  1001 

EP 

0011  1010 

ES 

0011  1011 

ICX 

0011  1100 

OCX 

0011  1101 

0 — ► A 

A + 1 — ► A 

1 —*■  A 

1 + A — ► A 

ARITHMETIC  RIGHT  SHIFT  (D  TIMES) 
ARITHMETIC  LEFT  SHIFT  (D  TIMES) 
LOGICAL  RIGHT  SHIFT  (D  TIMES) 
SET  SIGN  BIT  OF  A REG  TO  ZERO 
SET  SIGN  BIT  OF  A REG  TO  ONE 
X — ► A and  A — *>  X 
A — ► P and  P — ► A 
A — *•  W and  W — ► A 

X + D — ► X,  SKIP  NEXT  IF  SIGN  BIT 
CHANGES 

X-D— ► X,  SKIP  NEXT  IF  SIGN  BIT 
CHANGES 


OP  CODE  DISPLACEMENT 


INSTRUCTION  FORMAT  FOR  REGISTER  OPERATIONS 


jOP_ 
8 bits 


D_ 
12  bits 


Figure  35.  Register  operation  Instruction* 


CODE 

BINARY 

OCT 

SE 

0111  0000 

160 

SG 

0111  0001 

161 

SL 

0111  0010 

162 

SNE 

0111  0011 

163 

SGE 

0111  0100 

164 

SLE 

0111  0101 

165 

SKN 

0111  1010 

172 

SKP 

0111  1011 

173 

SO 

0111  1100 

174 

SNO 

0111  1101 

175 

SAE 

0111  1110 

176 

NOT  USED 

0111  1111 

177 

ICX 

0011  1100 

074 

DCX 

0011  1101 

075 

SKIP  IF  C(E)  = A 

SKIP  IF  A>C(E) 

SKIP  IF  A<C(E) 

SKIP  IF  A ¥ C(E) 

SKIP  IF  A >C(E) 

SKIP  IF  A<C(E) 

SKIP  IF  A<0 

SKIP  IF  A >0  / 

SKIP  IF  PREVIOUS  CAUSED 
OVERFLOW 

SKIP  IF  PREVIOUS  CAUSED  NO 
OVERFLOW 

SKIP  IF  A REG  EVEN 

SEE  REGISTER  OPERATIONS 
SEE  REGISTER  OPERATIONS 


INSTRUCTION  FORMAT  FOR  SKIP  INSTRUCTIONS  OP  D 

8 bits  12  bits 

•Valid  following  compare  instruction  (C)  only. 


Figure  36.  Skip  instructions. 


CODE 

BINARY 

OCT 

NOP 

0011  1110 

— 

NO  OPERATION 

P 

0011  1111 

PAUSE 

PUSA 

0111  0110 

166 

PUSH  ALL  REGISTERS  ON  STACK, 

S + 12  — ► S 

PUSX 

0111  0111 

167 

PUSH  A.  X,  P,  W ON  STACK, 

S + 4 — S 

POPX 

0111  1000 

170 

POP  A,  X,  P,  W FROM  STACK, 

S-4  — ► S 

RTN 

0111  1001 

POP  P FROM  STACK,  S - 1 S 

01 

1111  1100 

DEVICE  D — ► A 

DO 

1111  1101 

A — ► DEVICE  D 

NOT  USED 

1111  1110 

376 

NOT  USED 

1111  1111 

377 

OTHER  INSTRUCTION  FORMAT— (SAME  AS  REGISTER  OPERATIONS) 


Figure  37.  Other  instructions. 
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In  the  case  of  memory  reference  in- 
structions, there  are  four  addressing 
options. 


AB 

Direct 

00 

Indirect 

01 

Indexed 

10 

Indirect,  Indexed 

11 

In  Figure  34,  the  symbol  E is  used  to 
indicate  an  effective  address  formed  in 
one  of  the  four  possible  ways  of.  If  D is 
the  symbol  for  a 12  bit  displacement  in 
the  instruction  word,  then 

Direct  E = D 
Indirect  E = C(D) 


S R4 

R5  (Working) 
R6  (Working) 

W R7 

R8  (Working) 

R9  (Working) 
AC  (Working) 
T (Working) 

Registers  R2,  R5,  R6,  R8,  R9,  AC,  and 
T are  used  as  working  registers  in 
microcode  operations.  Registers  RO, 
Rl,  R3,  R4,  and  R7  are  maintained  for 
the  microprogrammed  maching.  The 

A and  X registers  are  used  as 

conventional  accumulator  and  index 
registers  respectively.  The  P register  is 
the  program  counter  and  contains  the 
address  of  the  next  instruction  to  be 
executed.  The  S register  is  the  stack 


Indexed  E = X + D (sum  of  Index 
Register  and  D) 

Indirect,  Indexed  E = C(D)  + X 

where  the  symbol  C(D)  represents  the 
content  of  memory  location  D. 

The  register  assignments  in  the  Intel 
3002  chip  are  made  as  follows: 

Microprogrammed  Intel  3002 

Machine  Register 


pointer  and  contains  the  next  avail- 
able address  for  the  storage  stack 
located  in  main  memory.  The  W regis- 
ter is  used  as  a status  indicator  and 
will  be  used  in  interrupt  code. 

When  the  front  panel  reset  switch  is 
activated,  a logic  high  is  placed  on  pin 
36  of  the  Intel  3001  microprogram 
control  unit  The  logic  high  forces  the 
instruction  at  location  0008  in 
micromemory  to  be  executed.  The 
initialization  code  for  the  micropro- 
cessor is  placed  at  this  location. 


A 

X 

P 


R0 

Rl 


R2  (Working) 
R3 


The  last  instruction  in  the  initial- 
ization code  is  a JZR  (FETCH). 
FETCH  is  a label  for  row  zero  column 


!T 


15  and  is  the  starting  location  for  the 
instruction  fetch  code.  The  initiali- 
zation code  is  given  below  and 
assumes  that  the  initial  value  of  the 
stack  pointer  and  program  counter  are 
located  in  cells  0 and  1 of  main  memory 
respectively. 


The  instruction  fetch  code  is  located 
in  row  zero  column  15  (OOF16),  and  is 
used  to  fetch  the  next  instruction  to  be 
executed  from  macromemory.  The 
code  includes  a mask  so  only  the  12  bit 
displacement  is  loaded  into  the  AC 
register  of  the  Intel  3002.  The  AC 


000H:  INIT:  CLR  (A); 

OtA 

CLR  (X); 

0-X 

CLR  (W); 

0-W 

CLR  (T); 

0»T 

LMI  (T); 

T-MAR 

/♦WRITE  ZERO  TO  INTERRUPT  STRUCTURE*/ 

ILR  (W)  ROT; 

W AC 

LMI  (T)  FFl  RRM; 

0 MAR,  T + T 

ACM  (AC); 

C (0)  Ac  AC 

/*  C 0)  = INITIAL  VALUE  OF  STACK  POINTER*/ 

SDR  (S)  FFl; 

> 

0 

1 

LMI  (T)  ffl  RRM; 

1-MAR,  T + 1— T 

ACM  (AC); 

C (1)-AC 

/*  C (1)  =STARTING  ADDRESS  OF  PROGRAM*/ 

SDR  (P)  FF1 


JZR  (FETCH) 


register  is  also  copied  into  R9  for  later 
usage.  The  last  instruction  in  the  fetch 
sequence  contains  a JPX  instruction 
which  causes  a 16-way  branch  to  the 
various  “classes”  of  instructions. 
Figure  38  shows  all  conditional 


f 


branches  used  to  determine  the  macro- 
instruction to  be  executed.  Note  that 
many  unused  instructions  are  shown 
in  Figure  38  (FETCH),  allowing  for 
future  growth  to  more  complex  macro- 
instructions. The  fetch  code  also 
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Figure  38.  Conditional  branches  used  to  select  mtc 


1 


forces  the  P register  contents  to  the  ments  the  P counter  by  one.  The 
memory  address  register  and  incre-  fetch  code  is  given  below. 

OOFH:  FETCH:  LMI  (P)  FFl  RRM;  P MAR,  PZn  ir 

/♦LOAD  DISPLACEMENT  BY  MASKING  WITH  KBUSV 

001FH;  LTM(AC)  K01FFF;  M 01FFP  AC 

/♦SAVE  DISPLACEMENT  IN  REGISTER  R9  AND  BRANCH  TO 
INSTRUCTION  CLASSV 

02FH;  SDR  (R9)  FFl  JPX  (D,  J,  L,  REG,  I,  JI,  LI,  MSC, 

X,  JJ,  KK,  LL,  IX,  AA,  BB,  10); 

The  binary  codes  appearing  with  the  processing  algorithms  including  those 

mnemonics  shown  in  Figure  37  are  involved  in  correlation  or  template 

completely  determined  by  the  condi-  matching.  The  technique  is  deceptively 

tional  branches  given  in  Figure  38.  simple  but  can  save  a considerable 

amount  of  time  when  processing 
The  primary  use  of  the  EAI  640  rectangular  arrays  of  known  sizes, 

emulation  code  is  to  "glue"  special  Consider  Figure  39  which  shows  a N x 

tracker  code  instructions  together,  and  M subarray  inside  a larger  L * K array, 

to  ease  the  software  formation  problem  The  process  works  best  when  hardware 

with  easy  to  use  instructions.  The  bulk  loop  counters  can  be  used,  however, 

of  the  tracker  code  is  written  on  the  they  are  not  necessarily  required, 

microcode  level  and  most  of  the  Assume  that  the  larger  array  has  been 

software  development  time  is  in  the  stored  line  by  line,  sequentially  into 

tracker  special  instructions  given  in  memory  and  that  the  address  of  the 

Section  7.C.  first  element  in  the  subarray  is  known. 

Then  each  element  of  the  subarray  can 
The  emulation  code  is  stored  in  page  be  addressed  as  shown  in  the  flow 
1 of  micromemory  (first  512  locations)  chart  of  Figure  40.  The  advantage  of 
and  contains  the  initialization  and  the  technique  is  that  address  computa- 

instruction  fetch  sequences.  tion  requires  only  the  addition  of  fixed 

constants.  The  correlation  or  template 
B.  Addressing  Technique  for  matching  computation  is  only  slightly 

Image  Processing  more  complicated.  All  shifting  and 

addressing  associated  with  correlation 
This  section  details  a technique  or  template  matching  can  be  computed 

which  is  very  useful  in  many  image  by  the  addition  or  subtraction  of  fixed 

64 


LOAD  SOFTWARE  OR  HARDWARE  COUNTERS 
SUCH  THAT  CNT1  = CNT2  = 0 


w 

I 


i 


constants.  Multiplications  for  address 
formation  are  eliminated.  An  example 
of  template  matching  addressing 
can  be  found  in  the  flow  chart  of 
Figure  46. 

C.  Tracker  Microcode 

(1)  Routine  WIN.  Routine  WIN  is 
used  to  generate  tracking  gates  to 
indicate  track  point  on  the  TV  monitor. 
The  track  point  is  defined  by  (NX,  NY) 
the  column  and  row  locations  of  the 
tracking  gate  center.  Figure  19  shows 
the  9*9  array  which  is  inclosed  by  the 
tracking  gate  of  fixed  size,  and  Section 
3.C  gives  a description  of  the  latches 
which  must  be  loaded  to  generate  a 
tracking  gate  on  the  TV  monitor. 

The  variables  NX  and  NY  are  stored 
in  macromemory,  and  routine  WIN 
reads  these  values  along  with  the 
black/ white  control  word  which  de- 
fines the  color  of  the  tracking  gate. 

The  mode  latch  is  forced  to  the 
tracking  gate  mode  with  the  requested 
tracking  gate  color.  The  mode  latch 
status  word  is  also  updated  to  give  the 
current  mode  latch  status.  Figure  41  is 
a flow  chart  of  WIN  and  shows  the 
addressing  and  loading  of  the  tracking 
gate  control  latches  with  the  3002 
MAR  register. 

(2)  Routine  CROSS.  Routine 
CROSS  is  similar  to  WIN  except  that 
the  mode  latch  is  enabled  to  draw  a 
crosshair.  The  right  and  left  column 
latches  are  loaded  with  NX  and  the 


upper  and  lower  latches  are  loaded 
with  NY.  The  crosshair  color,  as  in 
routine  WIN,  is  determined  by  the 
black/white  control  word  in  macro- 
memory. 

The  flow  chart  for  CROSS  is  shown 
in  Figure  42. 

(3)  Routine  FRM.  Routine  FRM  is 
analogous  to  a shutter  release  on  a 
camera.  Execution  of  FRM  causes  a 
new  frame  to  be  loaded  into  image 
memory  (10K  memory). 

The  flow  chart  for  FRM,  shown  in 
Figure  43,  contains  all  operations 
performed  in  the  routine. 

(4)  Routine  WAT.  Routine  WAT  is 
used  only  after  FRM  has  been  executed. 
Routine  WAT  tests  the  sign  bit  of  the  I 
bus  to  determine  when  a frame  has 
been  completely  stored.  If  the  frame  is 
not  ready,  a wait  loop  is  entered  until 
the  sign  bit  goes  high  (frame  ready). 
The  flow  chart  for  WAT  is  given  in 
Figure  44. 

(5)  Routine  IMG.  Routine  IMG  is 
used  to  read  the  image  array  1(1, J),  as 
shown  in  Figure  19,  into  macro- 
memory stored  starting  at  address  IP 
(image  pointer).  The  image  pointer  IP 
address  is  located  at  20  octal  in  macro- 
memory. The  image  is  stored  line  by 
line,  sequentially  in  memory.  The 
routine  is  detailed  in  the  flow  chart 
shown  in  Figure  45.  Since  image  data 
is  read  into  macromemory  during  the 


( START  ) 

V J 

START 


I 
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Figure  42.  Flow  chart  for  routine 
CROSS. 


Figure  43.  Flow  chart  for  routine  FRM. 


Figure  44.  Flow  chart  for  routine  WAT. 
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^ START  ^ 


CNT1  = CNT2  = CNT3  = CNT4  = -10 
AC  - CP  Al  = IP 


REGISTER  ASSIGNMENTS 


R0  = -153 

R1  = WORKING 

R2  = -145 

R3  = P COUNTER 

R4  = STACK  POINTER 

R6  = AC 

R7  = Al 

R8  = AR 

R9  = WORKING 

AC  = WORKING 

T = SUM 


Al  « Al  ♦ 8.  CNT1  = -10.  CNT2  = CNT2  + 1 | 


VARIABLES 


CP  = CORRELATION  POINTER 
IP  = IMAGE  ARRAY  POINTER 
RP  = REFERENCE  ARRAY  POINTER 


| SUM— —C  (AC).  AC  = AC  ♦ 1,  CNT2  = -10,  CNT3  = CNT3  ♦ ll 

N°  iAI  = Al  - 153^— 


SUM  = CORRELATION  SUM 


| Al  g Al  - 145,  CNT3  = -10,  CNT4  = CNT4  + 1 | 


Figure  46.  Flow  chart  for  routine  COR. 
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vertical  blanking  interval  of  the  TV 
camera,  processing  can  involve  every 
frame  (123  frames/sec)  as  required. 

(6)  Routine  COR.  Routine  COR  is 
flow  charted  in  Figure  46.  Register 
assignments  are  also  given  in  the 
figure.  The  routine  uses  addressing 
techniques  detailed  in  Section  7.B.  The 
variables  AC,  AI,  and  AR  are  the 
current  address  of  an  element  in  the 
template  match  array,  image  array, 
and  referenc  e arrays  respectively.  The 
variable  CP,  IP  and  RP  are  the  address 
pointers  for  the  template  match  array, 
image  array,  and  reference  arrays 
respectively.  The  variable 
SUM  = E(M,  N).  It  should  be  noted  that 
the  program  counter  and  stack  pointer 
are  not  disturbed  by  the  routine 
execution.  The  result  from  routine 
COR  is  a 9 x 9 array  of  template  match 
scores  defined  by  Equation  6.5  (or 
Equation  6.4). 

(7)  Routine  MIN.  Routine  MIN  is 
used  to  find  the  point  of  best  match 
after  routine  COR  generates  the  9 * 9 
template  matching  array.  Since  the 
possibility  exists  for  multiple  mini- 
mums,  the  track  point  is  defined  to  be 
the  minimum  nearest  to  the  old  track 
point  Figure  47  defines  some  of  the 
variables  shown  in  the  flow  chart  of 
Figure  48.  Note  that  DX  = DY  = 0 
indicates  the  target  has  not  moved 
from  the  current  track  point.  Variables 
DX  and  DY  should  define  the  location 
of  the  minimum  nearest  the  current 
track  point  when  execution  of  MIN  is 


complete.  The  variables  MAX  and 
MIN  define  the  maximum  and  mini- 
mum of  the  template  match  array 
respectively.  The  variable  I and  J 
correspond  to  the  current  column  on 
row  being  checked.  It  should  be  noted 
variables  T and  N measure  the  close- 
ness of  a possible  minimum  to  the 
existing  track  point,  and  are  used  to 
discriminate  between  multiple  mini- 
mums. 

(8)  Routine  REF.  Routine  REF  is 
used  to  store  the  9 * 9 array  centered  at 
(DX,  DY)  as  defined  in  Section  7.Cf7)in 
macromemory  starting  at  location  RP, 
the  reference  pointer.  The  reference 
pointer  is  stored  in  location  21  octal  in 
macromemory.  The  data  array  is  read 
from  the  image  array  previously  stored 
in  macromemory.  Routine  REF  is  flow 
charted  in  Figure  49. 


(9)  Routine  MNV.  Routine  MNV  is 
used  to  compute  the  sum  of  all  elements 
in  the  9 * 9 array  R(I,J)  centered  in  the 
current  track  point  (DX,  DY)  as  defined 
in  Section  7.C.(7).  The  sum  can  then  be 
used  to  calculate  the  mean  value  by 
dividing  by  81.  The  computation  that 
takes  place  can  be  expressed  by 

9 9 , 

SUM  = E £ R 
i-i  j=i 

The  mean  value  obtained  from  SUM  is 
used  in  AGC  calculations  which 
control  the  gain  and  bias  latches. 


T = | DXJ  + |DY] 


N-IJMI 


TEMPLATE 

! MATCH 

ARRAY 


•'XNTZ^ 
CARRY _ 


MIN— »C  (278) 
MAX-*C  (26g) 
DX— C (32e) 
DY-C  (33a) 


JZR  (FETCH) 


Figure  48.  Flow  chart  for  routine  MIN. 
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The  flow  chart  for  routine  MNV  is 
shown  in  Figure  50. 


Execution  Time* 
Routines 


for  Tracker 


(10)  Routine  STD.  Routine  STD  is 
used  to  calculate  the  mean  deviation  a 
quantity  which  is  similar  in  nature  to  a 
standard  deviation  calculation.  The 
quantity  calculated  is  a measure  of 
dispersion  and  is  given  by 


SUM  = 81*  0 = 4 Z Z | 25*R',  ._  iTi  I 
i=l j=l  ' 

where  (R'i,j)  is  the  9*9  array  centered 
at  (DX,  DY)  as  defined  in  Section 
7.C.(7),  and  where  R'  is  the  mean 
value  of  the  elements  of  the  (R'itj) 
array. 


The  chart  in  Figure  52  shows  the 
execution  time  of  each  routine  along 
with  the  number  of  microcycles  not 
involving  a read  or  write  ( fi  cycles), 
and  the  number  of  microcycles  in- 
volving a read  or  write  (R/W  n cycles). 
The  computations  assume  a 160  nsec 
microcycle  and  a 320  nsec  read  or  write 
microcycle.  It  is  of  interest  to  note  that 
two  correlation  tracking  operations  or 
one  correlation  and  one  adaptive  gate 
tracking  operation  (simultaneously) 
could  be  accomplished  at  over  60 
frames  a second.  Though  the  advan- 
tages are  not  clearly  defined,  this 
result  is  indicative  of  the  power  of  the 
approach. 

8.  POWER  CONSUMPTION 
PACKAGING 


The  constant  2s  is  used  to  shift  the 
image  data  5 places  to  the  left  so  that 
the  image  data  will  be  consistent  with 
the  mean  value  R'  which  is  stored 
with  5 binary  places  to  the  right  of  the 
binary  point.  Since  division  operations 
must  take  place  in  macrocode,  SUM  = 
81  * °A  is  calculated.  The  quantity 
°A  = SUM/81  is  calculated  in  macro- 
code and  is  used  to  obtain  a measure  of 
the  dispersion  of  image  data  need  for 
gain  determination  (GAIN  latch). 


Figure  51  shows  a flow  chart  of  the 
calculations  performed  in  STD. 


The  packaging  problem  is  a very 
complex  one  for  the  system  given  in 
this  report,  and  it  is  clear  that  major 
problems  will  stem  from  intercon- 
nections of  components  and  high 
power  consumption.  However,  it  is 
useful  to  consider  chip  area  used  by  the 
DIP  chips  in  the  tracker.  The  needed 
area  can  be  graphically  illustrated  by 
placing  all  tracker  components  on  two 
6 inch  diameter  circular  areas  as 
shown  in  Figures  53  and  54.  The  area 
analysis  assumes  the  use  of  state  of  the 
art  memory  components  available  as 
of  this  writing  and  includes  only  those 
chips  needed  for  tracker  operation.  No 


. 


76 


Flow  chart  for  routlna  MNV. 
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ROUTINE 

CYCLE 
LESS  R/W 

READS  (R) 

WRITES  (W) 

EXECUTION 
TIME  (m  sec) 

WIN 

4 

6 

36 

.0089 

CROSS 

4 

6 

21 

.0066 

FRM 

1 

2 

13 

.0030 

IMG 

85 

86 

291 

.1013 

COR 

13,127 

81 

14,137 

6.4884 

MIN 

245 

324 

3,399 

.7259 

REF 

85 

81 

112 

.0726 

MNV 

84 

1 

119 

.0462 

STD 

85 

1 

1,168 

.2144 

WAT 

0 

0 

5 

.0000* 

19,301 

13,720 

588 

TOTAL 

7.67 

Figure  52.  Estimated  execution  times  of  tracker  routines. 
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74S175 


74S10 


74S175 


74S10 


74LS157 


74S112 


74S112 


74S111 


74S10 


74LS157 


74S112 


74S112 


74120 


74LS02 


74S260 


74S112 


74S08 


74S20 


74LS00 

74LSOO 

74LS00 

74S08 

74S08 

74S08 

74S04  | 74S04  | 74S04  | 74S04 

1 s « 

74S04  74S04  74S04  74S04  Jo 

— j 

74S04  74S04  74S157  74S174  K 


“ 3001 


5 

u.  * 


2K*8  PRQM 

r1 i 

2K*8  PROM 

82S191 

82S191 

2K*8  PROM 

2K-8  PROM 

82S191 

82S191 

2K*8  PROM 

2K«8  PROM 

82S191 

82S191 

;§  I 

CC  C/3 


Figure  53.  Graphic  Illustration  of  DIP  area  needed  for  tracker. 
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Figure  54.  Graphic  Illustration  of  DIP  chip  area  needed  for  tracker. 
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special  attempts  were  made  to  reduce 
area,  except  in  the  case  of  memory, 
analog  to  digital  conversion,  video 
control  latches,  and  operational  am- 
plifiers. The  bulk  of  the  chips  shown 
actually  exist  in  the  current  tracker 
hardware.  It  should  be  noted  that  an 
area  reduction  of  3:1  is  possible  using 
ceramic  chip  carrier  packaging  [6].  As 
an  illustration  of  what  this  means 
consider  the  chip  areas  shown  in 
Figures  53  and  54  would  become  3.4 
inch  diameter  circular  areas.  It  ap- 
pears that  power  consumption  rather 
than  package  size  is  a more  serious 
problem.  The  table  shown  in  Figure  55 
is  an  inventory  of  parts  used  in  the 
tracker,  along  with  power  consumptions 
of  individual  parts.  Only  limited 
attempts  were  made  to  reduce  power 
consumption.  Shottky  parts  are  used 
routinely  throughout  the  tracker.  It  is 
felt  that  many  paths  and  loading 
conditions  would  permit  the  use  of 
more  low  power  Shottky  parts  re- 
sulting in  a considerable  savings  in 
power  consumption.  The  power  con- 
sumption of  39  watts  typical,  56  watts 
maximum  is  high,  but  is  not  the 
"Hoover  Dam  Syndrome"  expected. 

9.  CONCLUSIONS 

This  report  contains  a new  concept 
for  an  imaging  tracker  using  a high 


speed  microprocessor.  The  tracker, 
capable  of  adaptive  gate  centroid 
tracking  and  template  matching  track- 
ing, achieved  each  type  of  tracking  at 
frame  rates  up  to  123  frames/ second. 
Therefore,  tracker  concepts  using 
simultaneous  tracking  of  centroid  and 
templates  are  possible  at  rates  of  60 
frames/second.  It  is  felt  that  the 
concept  of  using  a high  speed  micro- 
processor can  eliminate  much  hard- 
ware associated  with  image  processing 
trackers.  Though  power  consumption 
is  currently  on  the  high  side,  the 
tracker  hardware  concept  will  easily 
fit  in  a 6 inch  missile.  The  volume 
consumed  could  be  less  than  a six  (6) 
inch  cylinder  one  inch  in  height, 
exclusive  of  power  supply  volume.  It 
must  be  conceded  however,  that  ther- 
mal conduction  and  interconnection 
problems  could  force  a much  larger 
package  size. 

The  1980’s  will  usher  in  a new  era 
with  the  advent  of  VLSI.  The  speed- 
power  products  of  digital  integrated 
circuits  will  plunge  to  new  lows  as  the 
use  of  electron  beam  lithography  be- 
comes wide  spread.  Packaging  will 
become  more  dense.  All  indications 
are  that  the  tracker  in  this  report  could 
be  built  with  smaller  size,  lower  power 
consumption,  and  much  higher  per- 
formance in  the  1980’s. 
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NO 

CHIPS 

PART 

FUNCTION  AND  COMMENTS 

TYP 

MAX 

NO 

PINS 

8 

3002 

CENTRAL  PROCESSING  ELEMENT 

5.800 

7.600 

28 

1 

3003 

LOOK-AHEAD  CARRY  GENERATOR 

.400 

650 

28 

1 

3001 

MICROPROGRAM  CONTROL  UNIT 

.850 

1.200 

40 

22 

74S04 

HEX  INVERTER 

3.3 

5.940 

14 

5 

74S174 

HEX  D FLIP-FLOP  WITH  CLEAR 

2.250 

3.600 

18 

1 

74S11 

DUAL  JK  FLIP-FLOP 

.07 

1025 

14 

4 

74S157 

QUAD  2 TO  1 MULTIPLEXER 

1.0 

1.560 

16 

1 

74LS244 

OCTAL  BUFFER  WITH  3-STATE  OUTPUTS 

.135 

.230 

20 

3 

74LS00 

POSITIVE  NAND  GATE 

036 

.066 

14 

4 

74S08 

POSITIVE  NAND  GATE 

640 

1.140 

14 

3 

74S10 

POSITIVE  NAND  GATE 

225 

405 

14 

1 

74LS02 

POSITIVE  NOR  GATE 

.007 

.013 

14 

2 

74S20 

POSITIVE  NAND  GATE 

.100 

.180 

14 

2 

74S175 

QUAD  D FLIP-FLOP 

600 

.960 

16 

1 

74120 

DUAL  PULSE  SYNCRONIZER 

.255 

450 

16 

6 

74S112 

DUAL  JK  FLIP-FLOP,  CLEAR  AND  PRESENT 

.450 

.750 

16 

3 

74S260 

POSITIVE  NOR  GATE 

.390 

675 

14 

5 

74LS32 

POSITIVE  OR  GATE 

.122 

.245 

14 

4 

74LS76 

DUAL  JK  FLIP-FLOP,  CLEAR  AND  PRESET 

.080 

.160 

16 

1 

74LS90 

DECADE  COUNTER 

.045 

.075 

14 

4 

74LS93 

BINARY  COUNTER 

.180 

.780 

14 

1 

8T26 

TRANSCEIVER 

.435 

435 

16 

2 

74H21 

POSITIVE  NAND  GATE 
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56.307 

Figure  55.  Part  Inventory  and  power  consumption. 
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00472 
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000100 

J 

cage 
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0E47  3 

165372 

126006 

OVER 

IMG 

279t 

00474 
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000037 

LA 

BIAS 

26  0: 

00475 

176400 

040000 

DO 

4 

281: 

004  76 

000000 

000036 

LA 

GAIN 

282: 

00477 

176400 

050000 

DO 

5 

283: 

00500 

164000 

000000 

frm 

264*. 

00501 

167000 

000  066 

COR 

285: 

00502 

163024 

160606 

MIN 

MOVE 

WINDOW 

TO  NEk 

tracking 

POSITION 

286: 

00503 

000000 

00  00  32 

LA 

DELXX 

287: 

00504 

002600 

000036 

A 

NX 

268: 

00505 

060400 

000030 

ST  A 

NX 

289: 

00506 

000000 

000033 

LA 

delyy 

290: 

00507 

062600 

000031 

A 

NY 

291 : 

00510 

0e0460 

000031 

STA 

NY 

BOUND  ON  NX  AND  NY 

292: 

00511 

000000 

000030 

LA 

NX 

293: 

00512 

006000 

000732 

C 

N10 

294: 

00513 

072400 

000000 

SLE 

295: 

00514 

010000 

000520 

J 

NCK 

296: 

00515 

606000 

000732 

LA 

N10 

297: 

00516 

000400 

000030 

STA 

NX 

298: 

00517 

016000 

000525 

J 

outh 

299: 

00520 

006000 

000733 

NCK 

C 

N90 

300: 

08521 

072000 

000000 

SGE 

30l: 

00522 

010060 

000525 

J 

OUTH 

302: 

00523 

000000 

000733 

LA 

N90 

303: 

00524 

000400 

060036 

STA 

NX 

304: 

00525 

000000 

000031 

outh 

LA 

NY 

305: 

00526 

066000 

000732 

C 

N10 

3e6: 

00527 

072400 

000000 

SLE 

307: 

00530 

010060 

000534 

J 

NCK2 

308: 

00531 

600000 

000732 

LA 

N10 

309: 

00532 

000400 

000031 

STA 

NY 

310: 

00533 

010000 

000541 

J 

0UTH2 

3il: 

00534 

0 66  00  0 

000733 

NCK2 

C 

N90 

312*. 

00535 

072000 

000000 

SGE 

313: 

00536 

016000 

000541 

J 

0UTH2 

314: 

00537 

006000 

000733 

LA 

N90 

315: 

00540 

060400 

000031 

STA 

NY 

316: 

00541 

163400 

000006 

0UTH2 

WIN 

317: 

00542 

060000 

000030 

LA 

NX 

3ie: 

00543 

002400 

000412 

S 

062 

319: 

00544 

632400 

030000 

ALS 

3 

95 


I 


320: 

00545 

020000 

000406 

L 

convet 

321: 

005  46 

1 76  4p  0 

100000 

DO 

10 

322: 

0054  7 

000000 

00e031 

LA 

NY 

32  3 j 

005  50 

022  40.0 

000412 

S 

062 

324: 

00551 

032400 

030000 

ALS 

3 

32 1> : 

00552 

020000 

000406 

L 

CONVET 

326: 

00553 

176400 

070000 

DO 

7 

327: 
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000564 

L 

AGC 

328: 

00555 

077400 

000000 

LAI0US 

329  : 

00556 

005400 

000766 
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SSW7 

330: 
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000000 

SNZ 

331: 
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010000 

000563 

J 

J00V 

332: 

00561 

164400 

000000 

WAT 

333: 

00562 

010000 

000430 

J 

START2 

334: 

00563 
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000V 

J 

LOOP 

* SUBROUTINE 
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# 

MNV 
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00564 
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000000 
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354000 
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00565 
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LA 
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D 
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LA 
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D 
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2 
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LA 
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M 

C2 
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00600 

000400 

000762 
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LA 
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00602 
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M 
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350} 
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A 
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C 
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C 
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LA 
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M 
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LA 
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C 
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J 
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D 

GP933 

370: 

00627 

006000 

000753 

C 
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LA 

bias 

375: 

00634 

003400 

000751 

D 

GP933 

376  , 

00635 

00  04  00 

000  037 

STA 

BIAS 

377: 

00636 

010000 

000647 

J 

NOCHG 

378: 

00637 

000000 

000036 

FULL 

LA 

GAIN 

379: 

00640 

003400 

000753 

0 

FULLG 

360: 

00641 

000400 

000762 

STA 

TEMP 

38i : 

00642 

800000 

000037 

LA 

BIAS 

382: 

00643 

003400 

000762 

D 

TEMP 

383: 

00644 

000480 

000037 

STA 

BIAS 

384: 

00645 

000000 

000753 

LA 

fullg 

385: 

00646 

000400 

000036 

STA 

GAIN 

386: 

00647 

037000 

000000 

NOCHG 

NOP 

* FILTER  MEAN  VALUE 

387: 

00650 

000000 

000763 

LA 

MEANO 

386: 

00651 

803000 

000765 

M 

Cl 

389: 

00652 

000400 

000762 

STA 

TEMP 

390: 

00653 

000000 

000024 

LA 

MEAN 

391: 

00654 

003000 

000767 

M 

ONEMC1 

392: 

00655 

802000 

088762 

A 

TEMP 

393: 

00656 

000400 

000763 

STA 

MEANO 

394: 

00657 

006000 

000760 

C 

MNP* 

395: 

08660 

072000 

000000 

SGE 

396: 

00661 

818000 

000666 

J 

NEXT 

397: 

00662 

000000 

000037 

LA 

BIAS 

398: 

00663 

002000 

000746 

A 

oneone 

39  9! 

0 06  64 

000400 

000037 

STA 

BIAS 

400: 

00665 

010000 

000674 

J 

NEXT2 

401 : 

00666 

806000 

000756 

NEXT 

C 

MNSBPK 

402 : 

00667 

072400 

000000 

SLE 

403: 

00670 

010000 

000674 

J 

NEXT2 

4041 

00671 

000000 

000037 

LA 

BIAS 

405: 

00672 

002480 

000746 

S 

ONEONE 

406: 

00673 

800480 

000037 

STA 

BIAS 

407: 

0 06  74 

000000 

000037 

NEXT2 

LA 

BIAS 

408: 

00675 

006000 

000755 

C 

ZERO 

409: 

00676 

072000 

000000 

SGE 

410: 

00677 

830080 

000000 

CLR 

4ii: 

00708 

806000 

800754 

C 

FULLB 

412: 

00701 

072400 

000000 

SLE 

413: 

00702 

800000 

000754 

LA 

FULLB 

414: 

00703 

000400 

000037 

STA 

BIAS 

4i5: 

00704 

074408 

000000 

97 

RTN 

416  s 

00705 

037000 

000000 

SAGC 

NOP 

4171 

00706 

000000 

000736 

LA 

T7P0 

418  1 

00  707 

000400 

000756 

sta 

MNSBPK 

419 : 

00710 

000400 

000763 

STA 

MEANO 

42?: 

00711 

000000 

000740 

LA 

T14P5 

421: 

00712 

000400 

000761 

STA 

SDPK 

422: 

00713 

000400 

000764 

STA 

STDO 

423: 

00714 

000000 

000737 

LA  T8P0 

424: 

00715 

000400 

000760 

STA 

mnpk 

42b : 

00716 

000000 

000741 

LA 

T13P5 

426: 

00717 

000400 

000757 

STA 

SDSBPK 

* initalize  gain  to 

APPROXIMATELY  UNITY 

427  : 

00720 

000000 

000742 

LA 

T31 

428: 

00721 

000400 

000036 

STA 

GAIN 

429: 

00722 

176400 

050000 

DO 

5 

* INITALIZE  bias  TO 

approximately  black 

LEVEL 

4 30: 

00723 

000000 

000743 

LA 

DCBLK 

4 31 : 

00724 

0004  00 

000037 

STA 

BIAS 

4 32: 

00725 

176400 

040000 

DO 

4 

433: 

00726 

074400 

000000 

RTN 

434! 

00727 

000001 

000000 

TP5 

OCT 

20 

435: 

00730 

000003 

000000 

T1P5 

OCT 

60 

436: 

00731 

001600 

000000 

T14P0 

OCT 

34000 

437: 

00732 

000000 

120000 

N10 

OCT 

12 

438: 

00733 

000005 

120000 

N90 

OCT 

132 

439: 

00734 

000040 

000000 

TP5D 

OCT 

1000 

440: 

00735 

000140 

000000 

T1P5D 

OCT 

3000 

441! 

00736 

000016 

000000 

T7P0 

OCT 

340 

442! 

00737 

000020 

000000 

T8P0 

OCT 

400 

443! 

00740 

001640 

000000 

T14P5 

OCT 

35000 

444! 

00741 

001540 

000000 

T13P5 

OCT 

33000 

445! 

00742 

000001 

110000 

T31 

OCT 

31 

446! 

00743 

000000 

060000 

dcblk 

OCT 

6 

447  : 

00744 

005040 

000000 

T81 

OCT 

121000 

448: 

00745 

050400 

000000 

T81PRM 

OCT 

1210000 

449: 

00746 

000000 

010000 

oneone 

OCT 

1 

450: 

00747 

040000 

000000 

0NEMC2 

OCT 

1000000 

451: 

00750 

040000 

000000 

C2 

OCT 

1000000 

452: 

00751 

075660 

000000 

GP933 

OCT 

1735400 

453: 

00752 

000003 

020000 

FIFTY 

OCT 

62 

454! 

00753 

000017 

170000 

FULLG 

OCT 

377 

455: 

00754 

000017 

170000 

FULLB 

OCT 

377 

4 56! 

00  755 

000000 

0 00  00  0 

ZERO 

OCT 

0 

457: 

00756 

000016 

000000 

MNSBPK 

OCT 

340 

458: 

00757 

001540 

000000 

SDSBPK 

OCT 

33000 

459! 

00760 

000020 

000000 

MNPK 

OCT 

4 00 

460: 

00761 

001640 

000000 

SDPK 

OCT 

35000 

461: 

00762 
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01010 
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1 
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01012 
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1 
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